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Method and syste^n for providing a user profile 



The invention relates to a method of providing a user profile. 

The invention further relates to a system for providing a user profile. 

The invention fiirther relates to a computer program product. 



5 

Television receivers, set-top boxes and similar systems often comprise an 
electronic program guide (EPG) which is capable of receiving and decoding data such as a 
program title or program category, related to programs and other content items which will be 
transmitted in the near future. Generally, such an EPG shows a list of program titles and the 

10 clock-times, indicating at which time and by which channel the programs will be transmitted. 
Known user interfaces have the feature of keeping record of the users' preferences and 
interest. This kind of interest can be stored in a so-called user profile for a user. A user profile 
comprises metadata with several attributes, which can have values indicating the user's 
interest, lifestyle, and so on. A possible way of visualizing such a profile is the use of an 

1 5 agent. Such an agent can give advice, suggest programs or help in another way to let the user 
find information of interest. The agent is sometimes represented as a visual character, such as 
a talking anthropomorphic shape, which gives suggestions or advice visually and/or audibly. 
Such a visual character appeals to the user, since it allows him to interact with his user profile 
by interacting with the visual character. 

20 However, a disadvantage of such a character is that it is static and does not 

adapt to the user profile. This makes it difficult for the user to associate the recommendations 
with the character that provides them, and makes the reasons for those recommendations 
opaque to the user. 



25 

It is an object of the invention to provide a method of providing a user profile, 
which allows a user to identify himself with the user profile. 

This object is achieved according to the invention in a method comprising 
representing the user profile as a corresponding shape comprising at least one icon 
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representing a content item, and guarding the consistency between the user profile and the 
corresponding shape. The consistency is preferably guarded by changing the corresponding 
shape in dependence on a change in the user profile, and can further be guarded by changing 
the user profile in dependence on a manipulation of the corresponding shape. The invention 
is based on the insight that a visual representation of any form of advice should have some 
appeal to the user's taste. It then becomes possible for users to identify themselves with the 
user profile. The visual attributes of a shape are the parameters that can be subject to 
personalization. Such personalization of a user interface might help to experience more 
natural interaction. Visualization of a user profile is preferably done by means of an animated 
body. The animation, that is behaviors of the body, depends on processes inside of the body, 
in the so-called "belly", as well as outside, within the environment. 

Where user preference profiles should be taken into account, these profiles 
should best be represented as sets of earlier selected items that were considered enjoyable. 
For an advisor to be taken seriously, its advises should have had high predictive values in the 
past. To this end, the corresponding shape comprises icons representing content items that 
were considered enjoyable. 

It is a further object of the invention to provide a system for providing a user 
profile, which allows a user to identify himself with the user profile. 

This object is achieved according to the invention in a system comprising user 
profile maintenance means for maintaining the user profile, visualization means for 
representing the user profile as a corresponding shape comprising at least one icon 
representing a content item, and consistency guarding means for guarding the consistency 
between the user profile and the corresponding shape. In this system, the visualization means 
ensure that users are provided with a representation of their profile with which they can 
identify. The consistency guarding means are preferably arranged for causing the 
visualization means to change the corresponding shape in dependence on the user profile 
maintenance means changing the user profile. Additionally, the consistency guarding means 
may be arranged for causing the user profile maintenance means to change the user profile in 
dependence on the visualization means changing the corresponding shape. This way, the 
consistency guarding means can ensure that any changes to the user profile are carried 
through in the corresponding shape, and vice versa, thereby guaranteeing their consistency. 

In an embodiment the visualization means are arranged for removing an icon 
representing a content item from the shape comprising said icon in response to the user 
profile maintenance means removing the content item from the user profile. A content item 
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whose relevance has decreased, can be deleted. It is then removed from the user profile. To 
guarantee the consistency, the corresponding shape must be adapted. This can for instance be 
done by generating an animation in which the icon representing the removed content item is 
removed and tiie shape shrinks or trembles. 

In a further embodiment the user profile maintenance means are arranged for 
determining a subset of the content items comprised in an existing user profile, generating a 
new user profile comprising said subset and feeding the new user profile to the visualization 
means, and the visualization means are arranged for visualizing a new shape corresponding to 
the new user profile by visually splitting off the icons corresponding to the content items 
comprised in said subset from the shape corresponding to the existing user profile and 
visually forming the new shape. The new shape can exist as a portion of the existing shape, 
or as a new, independent shape. By splitting the shape into plural new shapes, which then act 
independently, a large user profile can be managed efficiently. Each shape provides a 
simplified view on the profile, and the user can choose to interact only with one set at a time, 
for example, only with movies, or only with news, etc. The profile can be split at the 
initiative of a user, for example with a button press on the remote control. The profile splits 
according to the meta-data content description, for example into groups showing different 
genre. 

In a further embodiment the visualization means are arranged for showing an 
icon representing a content item, and in response to receiving an indication of a preference 
for the content item, adding the icon representing the content item to the shape corresponding 
to the user profile and communicating said indication to the user profile maintenance means, 
the user profile maintenance means being arranged for adding the content item to the user 
profile. A content item which might be relevant for a user is offered to the user as an icon. 
The user can check the offer, e.g. by viewing it on his television receiver, and is then given 
an opportunity to accept or reject the offer. When the user accepts the content item, the shape 
corresponding to the user profile incorporates the icon. To the user, this represents adding the 
content item to the user profile, so this change should be incorporated in the user profile. 

The invention further relates to a computer program product being arranged 
for causing a processor to execute the method of the invention. 

These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments shown in the drawing, in which: 
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Figure 1 schematically shows an embodiment of the system according to the 

invention; 

Figures 2a-g schematically show several possible embodiments of visual 
output as produced by the system; 

Figure 3 schematically shows a set of default representations for use in the 

system; 

Figure 4 shows the system according to the invention in more detail; 
Figure 5 illustrates a method of adapting the shape of a representation; 
Figure 6 shows a shape obtained with said method; 

Figure 7 shows a deconstruction of said shape into a series of simpler shapes 
that represent the growth path leading to said shape; 

Figure 8 shows how rules for this deconstruction are derived. 



Throughout the figures, same reference numerals indicate similar or 
corresponding features. Some of the features indicated in the drawings are typically 
implemented in software, and as such represent software entities, such as software modules 
or objects. 

Figure 1 schematically shows an embodiment of the system 100 according to 
the invention. The system comprises user profile maintenance module 110, visualization 
module 120, and consistency guarding module 130. 

The user profile maintenance module 120 maintains a user profile. The 
visualization module 120 represents a content item, such as a television program, visually as 
an icon 101. The visualization module 120 represents the user profile as a corresponding 
shape 102 comprising at least one icon 101 representing a content item. The consistency 
guarding module 130 guards the consistency between the user profile and the corresponding 
shape 102. 

The consistency guarding module 130 preferably operates by causing the 
visualization module 120 to change the corresponding shape in dependence on the user 
profile maintenance module 110 changing the user profile. Additionally, the consistency 
guarding module 130 causes the user profile maintenance module 1 10 to change the user 
profile in dependence on the visualization module 120 changing the corresponding shape. 

A visual representation of any form of advice should have some appeal to the 
user's taste. It then becomes possible for users to identify themselves with the user profile. 
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The visual attributes of a shape, are the parameters that are subject to personalization. Such 
personalization of a user interface might help to experience more natural interaction. 
Visualization of a user profile is preferably done by means of an animated body. The 
animation, that is behaviors of the body, depends on processes inside of the body, in the so- 
called "belly", as well as outside, within the environment. 

The shape can be of any form, but preferably is anthropomorphic, i.e. taking a 
more or less humanlike shape or form, such as with a belly comprising the icons, and limbs 
like arms and/or legs to allow direct manipulation and visual feedback. This makes the shape 
easily recognizable and intuitive to interact with. However, the shape might also be 
amorphous, i.e. not having a rigidly defined form such as a rectangular or gridlike 
arrangement. 

It is beneficial to users that their profile, as maintained by the system 100, 
could get a visible and interactive representation. Such representation in form of animated 
shapes that can depict user preferences is communicative, in the sense of being able to 
commimicate about internal system states and changes in information. The main interactive 
role of these user profiles is to be a direct manipulation tool for accessing content. Such a 
direct manipulation tool can enable an explicit user feedback. This way the personalization 
through adaptation might be achieved. 

The idea of growing potentially infinite amoimt of shapes in a process of 
artificial evolution is a solution to the problem of personalization. In this respect the 
personalization is understood broader than only filtered digital content delivery, and it 
includes the appropriate visualization for the adaptive system. 

This means that an existence of sets of liked or disliked contents is taken as a 
starting point and the problem of interactive visualization is how to show changing status of 
such sets, as well as how to show that different sets belong to different users, assuming that 
all users would like to identify with their own representation as well as to recognize to whom 
visible sets belong. 

The system 100 can be realized as a computer program product 140, which 
can be stored on a storage medium such as a floppy disc or CD-ROM, or made available over 
a network by a file server. The computer program product 140 will, when loaded into a 
programmable device, cause a processor in said device to execute the method according to 
the invention. The computer program product 140 enables a programmable device when 
executing said computer program product 140 to fimction as the system 100. 
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Figures 2a-g schematically show several possible embodiments of visual 
output as produced by the system. To properly appreciate the invention, its workings will 
now be discussed in terms of the output, rather than the components. The construction of the 
system 100 will be discussed later, with reference to Figure 4. 

Figure 2a shows a visual representation 102 of a user profile and an icon 101 
representing a content item, for example, a digital TV program. The visualization module 120 
shows the icon 101 preferably when the user notifies the system that he likes the content item 
in question. The representation 102 is presented here as an anthropomorphic shape, with 
limbs and a belly comprising an icon representing a further content item that is incorporated 
in the user profile represented by the representation 102. 

When the user notifies the system that he likes the content item, the content 
item is of course also added to the user profile. 

Figure 2b shows the representation 102 after several content items have been 
incorporated in the user profile. The "belly" of the representation 102 is growing big, and the 
representation 102 may have grown more or different limbs. 

Figure 2c shows an alternative embodiment of the representation 102 
interacting with the user. Limbs are used to visualize the changes in the user profile. For 
instance, the limbs can be use to animate the adding of the content item represented by icon 
101 to the user profile, by grasping the icon 101 and adding it to the belly of the 
representation 102. Alternatively, the representation 102 may be provided with a moutii, and 
adding can then be animated by swallowing the icon 101 in tiie mouth. Limbs are also seen as 
a possible way of gesture based communication with users. 

Figure 2d shows the representation 102 in which the incorporated content 
items have been grouped into two groups 103, 104. The groups 103, 104 can be distinguished 
by some criterion, for instance by genre or television channel. The representation 102 as 
shown in Figure 2c shows two news programs in tiie first group 103, and four movies in the 
second group 104. 

Figure 2e shows the representation 102 fi:om which a new representation 105 
has been split off. The user profile maintenance module 1 1 0 can determine a subset of the 
content items comprised in an existing user profile and generate a new user profile 
comprising said subset. This new user profile is then fed to the visualization module 120, 
which then visualizes the new shape 105 corresponding to the new user profile by visually 
splitting off the icons corresponding to the content items comprised in said subset fi-om the 
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representation 102 corresponding to the existing user profile and visually forming the new 
representation 105. 

In Figure 2f , an icon is removed from the representation 102. This is 
visualized by generating an animation of a trembling representation 102, which may also 
5 shrink in whole or in part to visualize that its "belly" grows smaller. The icon may be 
removed because the user explicitly requested it, for example by voting negatively on the 
content item corresponding to the icon being removed. This is then communicated to the user 
profile maintenance module 110, which removes the content item in question from the user 
profile. The user profile maintenance module 110 may also have determined that the content 
10 item in question is no longer relevant and eliminate it fi-om the user profile. This is then 
communicated to the visualization module 120, which performs the visualization described 
above. 

Figure 3 shows a set of default representations. Visual adaptation of the 
interface is achieved by introduction of a set of default representation, fi-om which users can 
1 5 select the preferred one, the one which will indicate the direction of evolution of individual 
user profile. 

The final shape of a representation depends not only on the style chosen by a 
user, but it is also determined by behaviors, which depend on environmental circumstances, 
such as the spatial arrangement of content, which might provoke a quicker growth of some 
20 limbs and atrophy of others. 

This means that even if each "embryo" will have encoded a possibility of 
growth of, say, at most five legs, it is not necessarily the case that it will grow all of them, 
neither what precise shape and size they will be. The coded features of possible growth - that 
is "genes" result firom the parameterization of shapes. The approach to parameterize shapes 
25 for growth is described in details below. 

Separately to largely vmpredictable growth, representations will have defined 
behaviors to communicate in a natural way about their current status. This means, that they 
will be allowed to grow, for example a hand to be able to wave, if a filtering agent will find a 
piece of content relevant to user preferences. 
30 Figure 4 shows the system 100 in more detail. Content source 402 delivers 

information related to content items such as television programs, world-wide web documents, 
literature, and so on. 

The user profile maintenance module 110 holds the user profile 403, a 
collection of items P that were enjoyed in the past and possibly also a collection of items Q 
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that were disliked in the past. It further comprises a filter 404 that compares the relative 
distances D(N,P) and D(N,Q), for new incoming items N. Any new incoming item is passed 
by this filter 404 and the outcome of the relative distances triggers the subseqvient behaviors 
of the user profile maintenance module 110, which are generated by behavior generating 
5 module 405. If this distance is sufficiently small, for instance if it is less than the distance 
D(N,Q) between the new item and items Q that are assixmed to be outside the user's user 
profile 403, the system 100 could conclude that it is worthwhile to recommend N to the user; 
otherwise, a negative advice should be given. Gradual changes in the user's profile 403 could 
lead to the removal of old items or to replacement by other items. Also these updates give 

1 0 rise to visual behaviors, which might require user feedback. 

At a high level, a behavior consists of rather complex motion pattems, each 
motion pattern associated to one type of database update or one primitive interaction clause. 
At a lower level, these behaviors are decomposed in terms of primitive motion primitives: 
waving a tentacle, grasping an icon, jumping up and down to draw attention, and so on. 

1 5 These low-level motions are generated in motion generating module 406. Structure module 
407 represents the articulated 'body' topology of the representation; it represents all kinetic 
degrees of freedom. However, the components in the structure module 407 are not directly 
visible: they could be seen as skeletons. The actual geometric shape of the various parts that 
adorns these skeletal elements in many possible ways is determined in shaping module 408, 

20 and the visual quality in the form of color schemes, textures and (faked) illumination effects 
is added in rendering module 409. As in the example of Figure 2, the total animated images 
may contain both the synthesized moving creatures and iconic material that represents the 
current user profile 403. The motions of the animated creatures should drive the placement of 
these icons, and icon placement module 410 manages this. Notice that it gets its contents 

25 firom the current state of the user profile. 

The rendered animated advisor-creature and the iconic material that represents 
the current user profile 403 is shown on display device 412 that may or may not form a 
physical imity with the display device that shows the actual visual contents 413, for example 
a TV screen, a virtual book or an LCD screen. 

30 The user can further be provided with a direct input module 415, allowing a 

direct selection of contents. Since a useful profile that truly represents the user's taste will 
only grow overtime, there has to be a way to solve the 'cold start problem'. The first couple 
of choices for a new user cannot be made using the filter mechanism outlined above. So the 
first entries in P will result from direct selection. 
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A primary, mechanism for adaptation is the dynamic update of the sets P and 
optionally Q. But the visual appearance of the advisor should also adapt. A general proposed 
mechanism is the following: each of the behavior generating module 405, the motion 
generating module 406, the shaping module 408 and the rendering module 409 can be 
5 defined by means of a set of rules that generate a behavior, a motion, a shape and a rendering 
style. The shaping module 408 indicates a possible way of implementing and applying these 
rules. Every rule has a weight factor, and rules can by applied at random where the chance 
that a rule is chosen is determined by its weight factor. The rules should be such that 
whatever rules are applied, in whatever order, the total behavior is always according to the 

1 0 high-level goals, and the updates to user profiles and the filtering actions always take place in 
an appropriate way. Also, whatever the precise shape, defined by the shape-formation rules, 
it has always to be compatible with the structure as defined in structure module 407, since 
this structure is necessary to execute the motion patterns that together form the visual 
representation of the database updates on the sets P and Q. 

1 5 Adaptation to the user's taste can now be realized through an evolutionary 

process, as follows. At specified time points, for example once per interaction session, some 
random selections of rules is performed, and behavior, motion, shape and rendering styles are 
constructed according to the selected rules. All of this should generate a small number of 
different creatures which are all identical with respect to the semantics of the activities they 

20 perform in order to convey the system messages, e.g. database operations. They are, 

however, very different v^th respect to the fiirther details of their behavior, their motions, 
their shape and their rendering styles. Next the user is asked to select one of these creatures. 
The weights or fitness of the rules that contributed to the generation of the chosen version are 
somewhat increased; whereas the weights of the other rules are decreased. A new generation 

25 of creatures is then performed, where the probability of using a certain rule is proportional to 
its fitness. In the next session, the exercise is repeated; where it is made sure that the 
preferred creature of last time is again among the offered alternatives. In this way, the user is 
certain that he never gets creatures that are a worse match to his taste than the previous time. 
In this process, the population of creatures evolves, together with the set of weights of the 

30 rules generating those creatures. It is assumed that the set of weights obtained in this way 
form a representation for the user's taste according to behavior details, motions details, 
shapes and rendering styles. If this can be confirmed, the mechanism will indeed lead to 
converging weights, and hence, to a creature that is adapted to the user's taste. 
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Generation, of the shapes can be done through a combination of a shape 
grammar and non-linear warping. Shape grammars have been used extensively for describing 
shapes in a procedural way, as is known from for instance Lindenmayer, Aristid, 
Mathematical Models for cellular interactions in development, I & II, Journal of Theoretical 
5 Biology, 1 8, pp. 280-3 1 5, 1 968; Prusinkiewicz, P., and A. Lindemayer, and J. Hanan, 
"Developmental methods of Herbaceous Plants for Computer Imagery Purposes", 
Proceedings of SIGGRAPH 1988, pp. 467-478; or M. Sonka, V. Hlava, R. Boyle, "Image 
Processing, Analysis, and Machine Vision", 1999, Brooks/Cole Publishing Company, Pacific 
Grove, CA (USA), pp. 315-323. 
10 A shape grammar consists of a fmite set of substitution rules. A substitution 

rule has three components: a type name-substitution rule, a structure-substitution rule, and a 
shape-substitution rule. 

^- A substitution rule serves to substitute a shape segment by one or more other 

shape segments. A shape segment is, in its simplest form, a cvirve together with a 

- 1 5 quadrilateral (ABCD) and a type name. A type name-substitution rule has the form 
7„ <type name 0> -> <type name Ixtype name 2><type name 3> . . .<type name n>, for 
instance: U->VU. 

The structure-substitution rule and the shape-substitution rule defme what the 
_7 two curves, in this case, and the quadrilaterals are that together will replace the single shape 
■ 20 segment with type name U from the left hand side of the type name-substitution rule. The 
^ structure-substitution rule and the shape-substitution rule that accompany the type name- 
substitution rule U->VU are defined graphically. This replacement rule is shown in Figure 5. 

The interpretation of this figure is as follows. Whenever this rule is to be 
applied onto an existing shape segment, this shape segment has to have name-type 'U' (this is 
25 expressed by the left hand clause, 'U' in the type name-substitution rule U-»VU). If such an 
existing shape segment, say ul, has been found, a transformation is constructed that maps the 
quadrilateral ABCD in the above figure to ul 's quadrilateral. It can be shown that such a 
mapping is a so-called bi-linear transformation. This geometric mapping is then applied to 
the two quadrilaterals in the right hand part: the dashed one and the dash-dotted one. The 
30 same geometric transformation is also appUed onto the two thick curves (the solid curve and 
the stippled curve). These two curves will replace the original curve that belonged to ul. 
Further, ul's quadrilateral is replaced by the two smaller (transformed) quadrilaterals, the 
dashed one and the dash-dotted one. Finally, the name type 'U' for the entire segment ul is 
now replaced by a concatenation of two name types, 'V and 'U'. This means that in a next 
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round, the same i:ule could again apply to the right most newly created shape segment; 
however, in order to replace tiie left most newly created shape segment, we caimot use this 
rule. If no rule was provided that has the name type 'V in its left hand part, it cannot be 
transformed at all; in this case it is called a terminal symbol. If one or more rules of the form 
5 'V-» . . ..' are provided, tiiese rules could be applied at a later stage, and the shape segment is 
called a non-terminal symbol. 

As mentioned, it has particular advantages to specify the geometric 
transformation that will be applied by means of the sfructure-substitution rule in terms of bi- 
linear transformations, parameterized by quadrilaterals. Indeed, suppose that the shape 

10 segment that belongs to ul has a curve that starts in the point A of ul 's quadrilateral and ends 
in the points D of ul 's quadrilateral. We observe that the two new curves then have the same 
property. So if the original curve was connected to the rest of the shape (that is, the rest of the 
shape cormected exactly to the points A and D of ul's quadrilateral), then this connection is 
maintained throughout the shape segment substitution. Even stronger: suppose that the shape 

1 5 segment belonging to ul was tangent to AB and tangent to CD, and that the rest of the shape 
smoothly connected to ul 's shape segment in A and D (i.e., the tangent of the remaining part 
of the shape in A was parallel to AB, and the tangent of the remaining part of the shape in D 
was parallel to CD), then this smoothness is also preserved. In other words, using structure- 
substitution rules that are parameterized by means of quadrilaterals, and that are implemented 

20 by means of the bi-linear mapping that maps the destination quadrilateral to the source 

quadrilateral, enables us to preserve, if so desired, connectivity (so called C° continuity) and 
smoothness (so called C' continuity). 

In this way, subsequent application of rules mimics the development of a 
complex shape out of a primitive shape. The following figures illustrate a part of the process 

25 that leads to the rules that should generate a complex shape. Figure 6 shows the final shape 
which a designer wants to obtain. Figure 7 shows a deconstruction of the final shape into a 
series of simpler shapes that represent the growth path leading to the final shape. In order to 
propagate firom one version to the next over this growth path the rules are needed. Figure 8 
shows how these rules are derived and cast in the form of substitution rules, including 

30 structure substitution in the form of appropriate quadrilaterals. 



